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Abstract. In this paper we study sufficient local conditions for the existence of non-trivial 
solution to a critical equation for the p(a;)— Laplacian where the critical term is placed as a 
source through the boundary of the domain. The proof relies on a suitable generalization of 
the concentration-compactness principle for the trace embedding for variable exponent Sobolev 
spaces and the classical mountain pass theorem. 



1. INTRODUCTION 

Let Q C be a smooth bounded open set. The purpose of this article is the study of the 
existence of a nontrivial solution to the critical trace equation 



-Ap^,^)U + h\u\P^''^-'^u = inn, 
\yu\pi^)-^duu = kr(^)-2^ on dn, 



where Ap^^,)^ = — div(| Vn|^^^^ ^Vn) is the p(x)-Laplacian corresponding to some given function 
p: — 7- (Ij+oo) (notice that when p is constant we recover the usual p-Laplacian) , di, is the 
outer normal derivative, and /i is a smooth function satisfying some coercivity assumption (see 
the definition of the norm in (j3.4p below). The exponents p: — )• (1, +00) and r : — t- [1, -|-cxd) 
are continuous functions that verify 

, (N — l)p(x) 

(1.2) 1 < p := inf p{x) < p := supp(x) < and r{x) < p^{x) — 



xen ^.gQ N-p{x) 

The exponent p^ is critical from the point of view of the Sobolev trace emebdding W^'P^^\n) 
L^^^\dn) (see Theorems 12.41 and 12.51 in section 2 below for a precise statement). 

We focus in this paper on the critical problem for (jl.ip in the sense that we will assume from 
now on that 

(1.3) AT:={xedn:r{x)=p^{x)}^$. 

Under this assumption the embedding VF^'^*-^^(il) ^ L^^^\dil.) is generally not compact so that 
the existence of a non-trivial solution to (ll.ip is a non-trivial problem. Our main purpose is to 
find conditions on p, r and 0, in the spirit of [T], |12) . and [17], where this kind of problem has 
been considered in the constant exponent case, ensuring the existence of a non-trivial solution 
to ([13]). 
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Observe that problem (ll.ip is variational in the sense that weak solutions are critical points 
of the associated functional 



:i.4) 



1 



p{x) V 



x) 



dx 



1 



do. 



r(x) 



where dS denotes the boundary measure. This functional F is well defined in W^'P^^\VL) thanks 
to p.2p (see Theorems 12.41 in section 2 below). The main tool available in order to find critical 
points for functionals in Banach spaces is the well known Mountain Pass Theorem (MPT). 
The MPT has two types of hypotheses, geometrical and topological. 

For the functional T it is fairly easy to see that when p+ < the geometrical hypotheses of 
the MPT are satisfied. The topological hypothese is the so-called Palais-Smale condition that 
requires for a sequence of approximate critical points to be precompact. When r{x) is uniformly 
subcriticaL i.e. 



:i.5) 



inf (p^(x) — r(x)) > 0, 
xedn 



the immersion W^'P^^\i}) ^ L^^^\dfl) is compact. It is then straightforward to check that the 
Palais-Smale condition is satisfied for every energy level c. 

Notice that there are some cases where the subcriticality is violated but still the immersion is 
compact. In fact, in |18| the authors find conditions on the exponents p and r such that At 7^ 
but the immersion remains compact. This type of conditions were first discovered in [27] where 

the embedding wJ'^^^^(O) ^ L'^^^'^Q), q{x) < p*{x) := Np{x)/{N - p{x)) was analyzed. The 
result in |18j shows that if the criticality set At is "small" and we have a control on how the 
exponent r reaches at the criticality set, then the immersion remains 
compact, and so the existence of solutions to (ll.ip follows as in the subcritical case. 

However, in the general case At 7^ 0, the present paper is, up to our knowledge, the first work 
regarding the existence of solutions for (|l.ip . 

Recently, in |18) . the authors analyzed the problem of the existence of extremals for the 
immersion W^'^^^\Vl) U'^^\dQ?j, that is functions realizing the infimum in 



0<r(p(-),r(.),J7) : = 



inf 



In |18) the main tool used to deal with the existence of extremals problem is the extension of the 
celebrated Concentration-Compactness Principle (CCP) of P.L. Lions to the variable exponent 

case. In the case of the immersion wl'^^^'Xn) ^ L5(^')(J7) this was done independently by |21| 



and [22J (see also [20] where a refinement of the result was obtained). For the trace immersion, 
this result was proved in the above mentioned paper |l8j. 

In order to state our main results we need to introduce some notation. Given some nonempty, 
closed subset F C dVt (possibly empty), we consider the space Wl'^^''\n) defined by 



t^j.i'PW(r?) := {u G C\^):u 



the closure being taken in the 

tI,p{x) 



ll,p(x)" 



in a neighborhood of F}, 
norm. This is the space of functions vanishing on F. 

l,p{x). 



Observe that Wl'^'^'^'iO) = VF^'P(^)(J)) and, more generally, that Wp'^'^'iO.) = W'^^P^''\n) if and 
only if F has p(x)— capacity zero. See |24| . Given a critical point x £ At, we define the localized 
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best Sobolev trace constant around x by 

(1.6) = supr(p(-),r(-),0.,r,), 

e>0 

where 

(1.7) T(p(-),r(-),n^,r^) = inf IHIv^^-^'")(n.) = ^r\Be{x), = nr\dBe{x). 

Our first result states that the functional J- defined in (|1.4p verifies the Palais-Smale condition 
for any energy level c below a critical energy level c* given by 



1 1 



. .- inf ( - ) 

xeAr \p[x) p*{x) J 

As an immediate corollary of this result, we obtain appplying the MPT the existence of a solution 
to p.ip provided there exists a function v G W^'P^''^\^l) such that 

(1.8) supT{tv)<c*. 

The rest of the paper is devoted to find conditions on p, r and 0, that allow us to construct 
a function v that satisfies (|1.8p . The idea used in the construction of such v is to rescale and 
truncate an extremal for the Sobolev trace immersion 



K(N,py^ = inf 




\Vf\^dx 



\frdy 



These extremals were found by Nazaret in [28j by means of mass transportation methods extend- 
ing the well known result of Escobar in [12\ where the case p = 2 was studied. These extremals 
are of the form 

N—p 

(1.9) Vx,y,{y,t) = X~V{y-^,j^), yGM^-\ t > 0, 
where 

N~p , 

(1.10) V{y^t)=r—, r = V(l + i)2 + |yp- 

Similar ideas were used recently in |18| were the existence problem for extremals in the critical 
Sobolev trace immersion was studied. These ideas were also previously used for (jl.ip in the con- 
stant exponent case by Adimurthi-Yadava [1], Escobar |12| . and Fernandez Bonder and Saintier 
in [17]. Let us mentioned that these ideas are classical when dealing with critical equations. They 
go back to the seminal paper of Aubin [2j and Brezis and Nirenberg ^ and have been widely 
used since then in the constant exponent case (see e.g. |l[m fTnlfTT|fT2lfT3lfT5lfT71 [25 t l3n i l3T | l32] 
and references therein). In the variable setting we refer to the recent paper [19] where analogous 
results for the critical problem with Dirichlet boundary conditions have been obtained. 

Organization of the paper. The rest of the paper is organized as follows. In Section 2, we 
collect some preliminaries on variable exponent spaces that will be used throughout the paper. In 
Section 3 we give an existence criteria for solutions, namely condition (II. 8p . In section 4 we give 
conditions that ensure the validity of such criteria. We leave for the Appendix some asymptotic 
expansions needed in the proof of our results. 
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2. PRELIMINARIES ON VARIABLE EXPONENT SOBOLEV SPACES 

In this section we review some preliminary results regarding Lebesgue and Sobolev spaces with 
variable exponent. All of these results and a comprehensive study of these spaces can be found 
in[8|. 

We denote by V{i^) the set of Lebesgue measurable functions p: — )• [1, oo). Given p £ 'P(J^) 
we consider the variable exponent Lebesgue space LP(^)(r?) defined by 

This space is endowed with the (Luxembourg) norm 

II II II II r ( ^ f ^(x) -I 

= \Mp(x) ■■= mf |A > : - • 

The following Holder-type inequality is proved in \16\ [2i6] (see also 0, pp. 79, Lemma 3.2.20 
(3.2.23)): 

Proposition 2.1 (Holder-type inequality). Let f G LP^''\^}) and g £ L'^^'^^Q). Then the 
following inequality holds 

ll/5llL^(-)(n) ^ ((-) + (~) )ll/llLf(-)(f7)lbllL'jW{n)) 

where 



1 1 1 

+ 



s{x) p{x) q{x) 

The following proposition, also proved in [26j . will be most useful (see also [8], Chapter 2, 
Section 1): 

Proposition 2.2. Set p{u) := J^\u{x)\p^'='^ dx. For u £ Lp(^)(J7) and {ut} ken C LP^''\n), we 
have 

(2.1) n / ^ {\\u\\Lp(-)(n) = ^ ^ pij) = l) • 

(2.2) \\u\\Lp(-){n) < 1(= 1; > 1) ^ p{u) < 1(= 1; > 1). 
(2-3) \W\\LP(-)^n) > 1 ^ Mlp(=^)(n) - P^^^ - Mi(-)iny 

(2.4) lkllLpW(f7) < 1 ^ ll^llLpW(n) ^ ^(^) ^ Mlp(^)(ny 

(2.5) lim \\uk\\Lp(x)(Q) =0<^ lim p{uk) = 0. 

(2.6) lim ||ufc||^p(a;)(Q-) = OO 4^ lim p{uk) = oo. 



The following Lemma is the extension to variable exponents of the well-known Brezis-Lieb 
Lemma (see [5j). The proof is analogous to that of [5]. See Lemma 3.4 in |21) 



Lemma 2.3. Let fn^f a.e and fn^fin LP^^\Q) then 

lim ( [ \fn\^^^Ux- [ \f - f^\P(-) dx) = I \f\P<^^Ux. 



n— >oo 
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We now define the variable exponent Lebesgue spaces on dO,. First we denote by V{dO,) the 
set of measurable functions r : dQ — t- [1, oo). We then assume that Q is so that dO, is 

a {N — 1)— dimensional immersed manifold on (although the trace theorem require less 
regularity on dQ, the regularity will be enough for our purposes). Therefore the boundary 
measure agrees with the {N — 1)— Hausdorff measure restricted to 90. We denote this measure 
by dS. Then, the Lebesgue spaces on d^l are defined as 



on 

and the corresponding (Luxemburg) norm is given by 
l^lli-WCaQ) = ll'"llr-(x),an := inf <! A > 0: 



\u(x 


)|r(x) 




u(x) 


f 


A 



dS < 1 



}■ 



We can define in a similar way the variable exponent Sobolev space ^i,pW(0) by 

T^i.P(^)(l^) = {n G LP(^)(J1) : diU G Lp'-''\Q) for i = 1, . . . , iV}, 

where diU = ^ is the i*'^— distributional partial derivative of u. This space has a corresponding 
modular given by 

Jn 

and so the corresponding norm for this space is 

(2-7) \\u\\w^'P(^)(n) = \Mi,p{x) ■= inf |a > 0: Pi,p(a;) < l}- 

The W^'P^^\ft) norm can also be defined as + ||Vn||p(-^). Both norms turn out to be 

equivalent but we use the first one for convenience. 
The following Sobolev trace Theorems are proved in 



Theorem 2.4. Let noR^ be an open bounded domain with Lipschitz boundary and letp G 'P{il.) 
be such that p G W^''^{Q) with 1 < p_ < p+ < < 7. Then there is a continuous boundary 
trace embedding W'^^P^''\n) C LP'^'^^dn). 

We used the following notation: for a ^u— measurable function / we denote /"*" := sup/ and 
/~ := inf /, where by sup and inf we denote the essential supremum and essential infimum 
respectively with respect to the measure p. 

The regularity assumption on p can be relaxed when the exponent r is unifortmly subcritical 
in the sense of (11.51). It holds 



Theorem 2.5. Let Q, C be an open bounded domain with Lipschitz boundary. Suppose that 
p G C^{d) and 1 < p~ < p~^ < N. If r ^ V{d^) is uniformly subcritical then the boundary trace 
embedding W^'P^^^ (il) — >• L^(^) (dQ) is compact. 

Corollary 2.6. Let QcR^ be an open bounded domain with Lipschitz boundary. Suppose that 
p G C^{Q) and 1 < p- < p+ < N . If r ^ C'^{dQ) satifies the condition 

1 < r{x) < p^{x) X G do. 

then there is a compact boundary trace embedding W^'P^^\Q) — )• L'^^^^dfl) 

For much more on these spaces, we refer to [8]. 
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3. Existence criteria for solutions 
We consider the equation 



(3.1) 



-Ap(^)U + /i(x)|u|P(^)-2n = inQ, 
|y^|p(x)-2^^^ = on dn, 



where Q C M'^ is a bounded domain, p G V^ft), 1 < p < < N, and r G V{dft) is critical 
in the sense that At 7^ where At is defined in (|1.3|) . In order to study (|3.ip by means of 
variational methods, we need to consider the functional J^: W^'P^^\Q) — )• M defined by 



p(x) V ; Jq^ r{x) 

Then u G H^i'P(^)(0) is a weak solution of (|3.ip if and only if n is a critical point of J^. We need 
to assume that the smooth function h is such that the functional 

(3.3) J{u):= [ |Vu|P(^) + /i(x)|tx|P(^)dx 

is coercive in the sense that the norm 

Vn + h[x)u{x 



(3.4) \\u\\ := inf <^ A > 



n 



p(x) 

dx <1 



A 

is equivalent to the usual norm || • ||i,p(x) of W^'P^^\Q) defined in ([27 

It is not difficult to prove that verifies the geometrical assumptions of the Mountain Pass 
Theorem (cf. the proof of Theorem l3.2p . The first non-trivial result needed to apply the Mountain 
Pass Theorem is to check that the Palais-Smale condition holds below some critical energy level 
c* that can be computed explicitly in terms of the Sobolev trace constant T{p{-),r{-),Q). Once 
this fact is proved, the main difficulty is to exhibit some Palais-Smale sequence with energy 
below the critical level c*. 

This approach has been used with success by several authors for treating critical elliptic 
problems, starting with the seminal papers of [2j |3l |6]. See, for instance [U |9l [101 El [121 [13 [13 
[13 [23 133 [3I1I32] and references therein. 

Our first result gives an explicit value of the energy below which the functional J-" satisfy the 
Palais-Smale condition. 

Theorem 3.1. Assume that h is such that J is coercive (see (j3.4p above). Then the functional 
T satisfies the Palais-Smale condition at level 

(1 1 \ _ 

p{x) p*{x) J 

Proof. Let {ufclfceN C W^^P^'^^n) be a Palais-Smale sequence for J-". Recall that this means 
that the sequence {J-{uk)}k^fq is bounded, and that J-'{uk) — ?• strongly in the dual space 
(P^i'P(^)(f)))'. Recalling that the functional J defined by (13. 3p is assumed to be coercive (see 
the norm (j3.4p above), it then follows that {n^l^g^ is bounded in W^'P'^^\Q). In fact, for k 
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large, we have that 

c + 1 + o(l)||nfc|| > J='{uk) - —{F'{uk),Uk) 

r 

>(4-— ) / \Vukf-^ + h{x)\uuf^Ux+ [ {— - J-)\nkr^-) dS 
r-^ Jn Jan f- r{x)^ 

>(4-— ) / \Vuk\P^^^ + h{x)\uk\P^^Ux={^-—)j{uk). 

We may thus assume that ^ u weakly in W^'^'^^\^). We claim that u turns out to be a 
weak solution to (|3.ip . The proof of this fact follows closely the one in |29j and this argument is 
taken from [TjiMj, where the constant exponent case is treated. 

In fact, since {ufcl^g^ is a Palais-Smale sequence, we have that 

{F'{uk),v)= f \Vukf^^~^VukVvdx+ [ h\uk\P^''^-\kV dx - [ \uk\'''^^'>-\kV dS = o{l) 
Jn Jn Jan 

for any v G C^{Q,). Without loss of generality, we can assume that ^ u a.e. in U, 'H^~^—a..e. 
in (9il, and in U''^^\Vl). It is easy to see, from standard integration theory, that 

/i|ufc|P(^)-2nfct;(ix^ [ h\u\P'~'-'^-^uvdx and I \ukY'^'''^-'^ UkV dS ^ I \u\''^''^-^uv dS, 
n Jn Jan Jan 

so the claim will follows if we show that 

[ \Vukf^''^'^VukVvdx^ [ \Vu\P^'''^-^VuVvdx. 
Jn Jn 

This is a consequence of the monotonicity of the p(x)-Laplacian. We can assume that there exist 
e G (LP'(^)(0))^ such that 

The idea is to show that Vu^ — t- Vn a.e. in Cl, then this will imply that ^ = |Vn|^^^)~^Vn and 
thus, the claim. 

Let 5 > then, by Egoroff 's Theorem, there exists Eg G ^ such that |il \ E'^l < 6 and ^ u 
uniformly in Eg. As a consequence, given e > 0, there exists feg G N such that \uk{x) — u{x)\ < e/2 
for X £ Eg and for any k > ko. 

Define the truncation /Sg as 



-e iit< -e 

t if - e <t < e 

e \it> e. 



Now we make use of the following well known monotonicity inequality 
(3.5) (|x|P-2x- |y|P-2y)(x-y) > 

which is valid for any x, y G and p > 1 and we obtain 

(|Vnfcr(^)-2Vnfc - \Vuf''^~^Vu)V {f],{uk - u)) > 0, 
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since 'VI3^{uk — u) = Vujt — Vn in Eg and V/3e(ufc — u) = in Q \ £^5. Therefore, we obtain 

/ (|Vufc|P(^)-2Vnfc - \Vu\P^''^~'^Vu){Vuk - Vn) dx 
Jes 

< f (|Vufc|^'(^)-2Vnfc - \Vu\P^''^-^Vu)VPe{uk - u) dx. 
Jn 

Now, observe that (^^{uk — u) ^ weakly in Wq''^^^\q,) and so 

/ |V'u|P(^)"^VuV/3£(ufc -u)dx^ 0. 
Jn 

Now, for k sufficiently large, we obtain that 

/ \Vukf^^^'^VukVI3siuk -u)dx< Ce 

for some constant C > 0. In fact, since I3e{uk - u) is bounded in 

{J"{uk),(5e{uk - u)) = 0(1), 



so that 



where 



and 



/ |Vnfc|P(")~2VnfcV/3,(nfc -u)dx = 0(1) + /i + /2, 
Jvi 

[ \ukY^''^-'^UkPe{uk-u)dS <£ f l^fcT^^^-^dS < 
Jan Jan 



h\uk\P^^'^-^Uk(3e{uk-u)dx <e\\h\\oo / \uk\P^''^-'dx<Ce. 

Jn 

As a consequence, we get that 

< limsup / (|Vufc|P(^')~2vnfc - |Vu|P(^)"2Vu)(Vufc - Vu) dx < Ce. 

fc— >-oo J Eg 

Since e > is arbitrary, it follows that (|VnA;|P*^^''^^Viifc — |Vn|P*^^)~^Vn)(Vnfc — Vn) — ^ strongly 
in L^{Es) and thus, up to a subsequence, also a.e. in Es. By a standard diagonal argument, we 
can assume that (| Vnfc|^^^^~^Vnfc — |Vn|P(^)~^Vn)(Vnfc — Vn) — )• a.e. in Es for every 6 > 
and so the convergence holds a.e. in Q. 

Finally, it is easy to see that {\xk\^~'^Xk — \x\P~'^x){xk — x) — )• for Xk,x G and p > 1 
imply that Xk — )• x, so we get that Vn^. — )• Vn a.e. in 0. This concludes the proof of the claim. 

By the Concentration Compactness Principle for variable exponents in the trace case, see |18) . 
it holds that 

(3.6) I'Ufcl'^^^^ dS ^ V = \uY^^'^ dS + Vi^x^ weakly in the sense of measures, 

(3.7) \Vuk\^^''^ dx^ fj.> |Vn|P(^) dx + ^ n^S^, weakly in the sense of measures, 
i3.»j Ixii^i < fJ-i 

where / is a countable set, {i^jjig/ and {/ij}jg/ are positive numbers, the points {xjjjg/ belong 
to the critical set At C dQ, and T^^ is the localized best Sobolev constant around Xi defined by 
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It is not difficult to check that Vk ■= Uk — u is a, PS-sequence for the functional defined by 

Now, by the Brezis-Lieb lemma [213] we get 

J^iuk) - F{u) = / ^ \Wvuf-^ + /ibfcr^^)] dx- I -^bfcr(") dS + 0(1) 
Jo. P{x) L J Jq^ r{x) 

= Hvk)+ I -^h\vkf^Ux + oil) 

Independently since li is a weak solution of ()3.ip . and recalling that p'^ < , we have 
J^{u) >^f( |Vn|P(^) + /i(x)|n|P(^)') dx- — [ j^r^^) dS 

= (1^.1.) f \u\ri^)dS 

Kp'^ r J Jan 
> 0. 

Therefore, T{uk) > P{vk) + o(l). Let 4> £ C^{n). As P{vk) ^ 0, we have 

o(l) = {T'{Vk),Vk(/)) 

= I \Vvk\P^''Udx- I |i'fcr(^Vrf'5+ / \Vvk\''^''^-^VvkV(l)Vkdx 

Jn Jdn Jn 

= A-B + C. 

Since {ufcjfcgN is bounded in and converges to in LP(^)(0), it is easy to see, using 

Holder inequality as stated in proposition 12. ![ that C — )• as — )• oo. Moreover by means of 
Lemma 12.31 (|3.6|) . and (|3.7p . there holds 



A — )• / (j)dfM and (j)dv, 
Jn Jan 

where jl = fi — \Vu\'''^^^ dx and 9 = 1/— |n|'~(^^ dS. So we conclude that Ji = D. In particular 

(iV-l)p(:t,) 

z^i ^ fJ'i [i ^ I) from where we obtain with (j3.8p that i>i > Tx^~^'^^^~^ . Hence 
c= lim Fiuk) > lim Pivk) = [ dji — I du 

k-^oo fc-s-oo J p[x) J r[X) 



p{x) r{x)) ^'^ "^XPi^i) P*{xi) 



Vi 



We deduce that if c < infjg/ {N-i)p(x ) '^^i ''''"''"^ then / must be empty implying that ^ u 
strongly in □ 

As a corollary, we can apply the Mountain-Pass Theorem to obtain the following necessary 
existence condition: 
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Theorem 3.2. Assume that > and that h is such that J is coercive (see ll[3.4\ ) above). If 
there exists v G W^'P^^\^}) such that 

(1 1 \ _ 

p{x) p*[x)J 



then (|3.ip has a non-trivial nonnegative solution. 

Proof. The proof is an immediate consequence of the Mountain-Pass Theorem, Theorem 13.11 and 
assumption (I3.9p . In fact, it suffices to verify that has the Mountain-Pass geometry and that 
J^{su) < for some s > 0. Concerning the latter condition notice that for s > 1, 

T{su)= / (|Vtir^^^ + /i(x)|u|P(^M dx- \ —-\u\'^^US 

n Vix) \ J an rix] 



I- ( iV'ulP(^) + dx - s'" I -^hr(^) dS, 

X) \ J an rix) 



p{x) V ' J ""^ " Jqq r{x) 

which tends to — oo as s — )• +oo since > p^. 

It remains to see that has the Mountain-Pass geometry. Clearly J-{0) = and, if 
s is small enough, then 

|V-t;|PW + /i|z;|P(^) dx > Ci\\v\\f,. = CisP^ 
since J is coercive, and on the other hand 

ll'y||r{a;),OQ < C*!!-" || l,p(x) = C S < 1 

for s small, so that 

Jan 

Therefore 



^(^) > _ ^s-- > 

p+ j.- 

since p+ < r^. This completes the proof. □ 



4. Local conditions for (|3.9p 

In this section we provide local conditions for (|3.9p to hold. These conditions are analogous to 
the ones found in [19] where the critical problem for the Laplacian with Dirichlet boundary 

condition was studied. 

The idea is to evaluate J^{sZs) for a suitable test function constructed by a scaled and 
truncated version of the extremal for K(N,p{x))~^ for a critical point x G At- Then, a refined 
asymptotic analysis will yield the desired result. 

In order to construct the test function we need to recall the Fermi coordinates from differential 
geometry. Briefly speaking, the Fermi coordinates describe a neighborhood of a point xq S dO, 
with variables {y, t) where y G M^^-*^ are the coordinates in a local chart of dQ such that y = 
corresponds to xq, and t > is the distance to dQ along the unit inward normal vector. 
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Definition 4.1 (Fermi Coordinates). We consider the following change of variables around a 
point xq G do,. 

We assume that xq = and that d^l has the following representation in a neighborhood V of 

0: 

dnnv = {xeV:xn = i^{x'), x' eU c R^'^}, nnv = {xeV:Xn> ^p{x'), x' eU C M^~^}. 

The function ip: U C M^"-*^ — )• M is assumed to be at least of class and that ip{0) = 0, 
V^p{0) = 0. 

The change of variables is then defined as <I> : [/ x (0, 5) — t- n ^ 

= {y,i;{y))+tuiy), 
where is the unit inward normal vector, i.e. 

(-V^(y),l) 



It is well known that for 5 > small $ defines a smooth diffeomorphism (see |12|). For a general 
construction of the Fermi coordinates in differential manifolds, we refer to the book 1231. 



Now, we are in position to construct the test functions needed in order to satisfy (13. 9p . Assume 
that G At C do,. Then, the test-functions we consider are defined in the Fermi coordinates by 

Ve{x) = r]{y, t)Vefl{y, t), x = $(y, t), 

where Vefl is defined in (jl.9p by rescaling an extremal V of K{N,p{0))~^, and 7] G C^{B2S x 
[0, 26), [0, 1]) is a smooth cut-off function. We normalize by considering the function defined 
by 

= Cve, C = K(Ar,p(0))-i(ra5) 
With this choice of C, the function Z{y, t) := CV{y, t) satisfies 

tn\ f tn\ - P(0)P(0)» 

|VZ|P(°) dydt = / |^|P(0). dy = K{N,p{0))~pW--pW . 
y JdR^ 

From now on, we assume that p G 'P{0,) and r G V{dn) are of class C^, G dQ and we let 
p := p{0) and r := r(0). 

In the propositions I A . 2 l I A . 31 and I A .41 in the Appendix we compute some asymptotic expansions 
needed in order to properly evaluate J^^sZe). These propositions are fundamental in the proof of 
our next result. We choose to postpone their proofs to the appendix because they are technical 
and long. 

Eventually the following result provides a sufficient local condition for (13. 9p to hold: 

Theorem 4.2. Assume that r~ > p"^ , and that h is such that J is coercive. Assume moreover 
that there exists a point xq G At such that T = Tx^ and such that xq is a local minimum of p{x) 
and a local maximum of r{x) and p{xq) < min{ \/iV, } . Assume eventually that one of the 
following conditions hold 

(1) f (xo) > 0, 

(2) ^(xo) = and H{xo) > or 

(3) ^{xo) = 0, H{xo) = 0, 1< p{xo) < 2 and h{xo) < or 
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(4) ^{xo) = 0, H{xq) = 0, p{xq) > 2 and Ap(xo) > or Ayr{xo) < 0. 

Then there exists a nontrivial solution to (|3.ip . Here ^(xq) = —d,^p{xQ) (with v the unit exterior 
normal vector), A.yr{xQ) := A(r o <!>(•, 0))(0), and Ap(xo) := A(p o <l*)(0). 

Notice that, as a consequence of the definition of the Fermi coordinates, we have that /S.yr{xQ) 
coincides with the Laplacian of r at xq for the natural metric of dVt. 

Proof. We assume, without loss of generality that xq = and denote p = p(0). Observe that 
r(0) = p*. 

We first consider the case where dtp{Q) > 0. In fact, from Propositions IA.2t IA.3I and \AA\ we 
have 

feis) = T{sze) = Dq + Di£\d.£ — Aq + o(elne) 
= h{s) + e\neh{s) + 0{e) 

C^— uniformily in s G [0,So]) with 



and 



_ p^i^p / s 

Us) = K{N,p)-— { 

\p p* 



his) = dtp{0) / t\VZ\Pdydt 

P P Jm" 



Notice that /o reaches its maximum in [0, sq] at s = 1. Moreover, it is a nodegenerate maximum 

- _ p^p 

since /o(l) = {p — p*)K{N,p) p*-p / 0. It follows that fs reaches a maximum at = 1 + 

f (i) 

aelne + 0{e) for a = —jTrj-^- Hence 



sup T{szs) =T{seZe) = K{N,p) p*-p + fi{l)e\n E + 0{e) 

s>0 \P P*J 

If dtp{0) > then /i(l) < and the result follows. 

Assume now that dtp{0) = and H{0) > 0. Then we have 

J'isze) = Dq + D2e + o(e) - Aq 
= fo{s) + f2{s)e + o{e) 

C^— uniformily in [0,So], with 

f^(s) = -H{0)— [ t\VZ\Pdydt + ^^^sP [ ^-^\VZ\Pdydt 
P Jr^ N -I 7iRiv 

As before reaches its maximum at = 1 + a£ + o{e) with a = y^^- So, 

sup-F(sz,) = T{seZe) =(---) K{N,p)-^ + /2(l)e + o(e) 

s>0 \P P*J 

So, we need that /2(1) < 0, i.e. 

-H{0)- [ t\VZ\Pdydt + ^^ [ ^-^\VZ\Pdydt<0. 
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But, 

- - [ t\VZ\Pdydt + [ ^-^iVZlPdydt 

< (-- + Tr-T) I t\VZ\Pdydt 
\ p N -IJ J^N 

< 

if p < — 1. So, since H{0) > 0, the result follows. 
Now suppose that dtp{0) = and H{0) = 0. Then 

T{sze) = Do + D^e'^ lne + o{e^ Ine) + CqeP + o{eP) - Aq - AxS^ Ine. 

If 1< p < 2 

T{sz,) = {Do - Ao) + Coe^ + o(e^') = fo{s) + his)eP + 0(8^) 

with 

Ms) = h{0)- / \VZ\Pdydt. 
P Jm^ 

As before fs reaches its maximum at 5^ = 1 + ae^ + o{e'^) with a = jrrjYj- Then, 
supT{sz,) = T{seZe) = (- - -\ K{N,p)-^p + Ml)£P + o{eP) 

s>0 \P P*J 

So, we need that /3(1) < 0. But, this is equivalent to /i(0) < 0. 
If p > 2, we have 

Tisze) = {Do-Ao) + {D4-Ai)e^lne + o{e^ Ine) = /o(s) + /4(s)e^ Ine + o(e^ Ine), 

with 

h{s)=--^(dup{0) [ t^\VZ\Pdydt + Ayp{0) [ \y\^\VZ\P dydz] 
P ^P\ Jr^ Jr^ ) 

+ — -LA,r(0) / lyl^ZP-dy. 
P* 2p* 

As before, we need that /4(1) < 0. Since is a local minimum of p(x) and a local maximum of 
r{x) and dtp{0) = it easily follows that /^{l) < 0. Moreover if one of the following inequalities 

Ayr{0) < < Ap(0) 

is strict, then /4(1) < and the result follows. □ 

Appendix A. Asymptotic expansions 

In this section we provide the asymptotic expansions needed in the proof of Theorem 14.21 

First we need the following asymptotic expansions for the Jacobian of the Fermi coordinates 
that are proved in [12]. 
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Lemma A.l. With the notation introduced in Definition \4-l\ the following asymptotic expansions 
hold 

J^{y,t) = l-m + 0{t' + \y\''), 
where H is the mean curvature of dQ. 
Also, if we denote v{y,t) = u{^{y,t)), 

N 

|Vn(x)|2 = {dtvf + {^'' + '^h^'t + 0{t^ + |y|2)) dy^vdy^v, 

where h^^ is the second fundamental form of dQ. 

The goal of this section is to prove the foUowing propositions. 
Proposition A. 2. There holds 

(A.l) / f{x)\ve\P^''Ux = CoeP + o{eP) with Co = /(O) / VPdx. 

2 ' 



Proposition A. 3. If p < 



(A.2) / f{x)\ve\''^''^ dS^= Ao + Aie^\iie + o{e^\ne) 

with 

^ = /(0) / Viy^^f-dy, 

Jrn-1 

and 

Ai = -^^/(O) / {D\{0)y, y)Viy, Of* dy 



2p 



= --^/(O)Ar(O) / \y\^V{y,Or* dy. 
Proposition A. 4. Assume that p < N'^/{3N - 2). Then 

[ f{x)\Vveix)\P^^'^ dx = Do + Di£lne + + D^{e\nef + D^e^ Ine + 0{e^ 
Jn 



with 



Do = f{0)[ \VV\Pdydt, D, = --f{0)dtp{0) [ t\VV\P dydt, 
and, assuming that dtp{0) = 0, 

D2 = (dtfiO) - Hf{0)) [ t\VV\P dydt + phf{0) [ ^-^\VV\p dydt, 

Jr'7 Jr^ ^ 



D3 = 



D4 = -^fiO)duP{0) / t^\VV\Pdydt-———f{0)AypiO) / \y\''\VV\P dydt 
2p Jrn 2{N - l)p " J^N 



EXISTENCE OF SOLUTION 15 

Proof of Proposition \A.S\ . We write 

/ f{x)\v,\P^-Ux= [ f{y,t)\v,{y,t)\P^y^'Hl + 0{\y\^ + mdydt. 
Jn JR^ 

Now the result follows as in [19] Proposition 5.1. □ 
Proof of Proposition \A.3i We have 

/<W dS= [ f{y, m)ve(.y, mr^''^^'^^ (l + 0(|y|')) dy. 

an JrJv-i 

Now the proof follows as in [19j Proposition 5.1. □ 

To treat the gradient term, we need the following result: 

Lemma A. 5. Assume p < N'^/{3N — 2) and that p = p{y,t) has a local minimum at {y,t) = 
(0,0). Given a bounded g € C^(il) and real numbers a*-', 1 < i,j < N — 1, we have 

Y,^'' jiy^tHy,t)\vVsf'^y''^-'d,Ve{y,t)djVe{y,t)dydt 

(A. 3) -j^^ JR^j^ 

= ^0 + Bie In e + Sge + Bsie In ef + B^e'^ In e + ©(e^) 

where di = tt-, o,nd 
' dyi ' 

Bo=dg{0) [ \VV{y,tr^-^dydt, = --g{0)dtp{0)d [ \VV{y,tr^-^dydt 

B2 =d [ \VV{y,t)\P*-^{g{0)dtp{0)ln\VViy,t)\+dtgm dydt 

Ar2 r l7/|2/2 

^3 =ir^9{0)dtp{0fa / | vy(y, dydt 
Jrn r^ 

B, = ---af \VV{y,t)\p'^^(-^-^dup{Q)+dtp{m9{^) + dtp{Q?9m dydt 



+ E ^^«"9,,p(0) / |Vy(y,t)rr-2 [y\ - 3y2y2) ^y^^ 



+ E U'dkkP{Q) + 2a''^d,up{Q)) f \VV{y,t)Y'r~^ylyldydt 



i,k=l 

where d = Yli^=i^ '^f^d r = r{y, t) = \/ {I + t^ + 
Proof. Notice that 



JV-l 



\VVe{y,t)\ = ^Lj^e^{{e + tf + 
p — \ 
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N-p ' ^ £^ 



So, \VVe{y,t)\ < 1 if \{y,t)\ > Ce^^^) where C = ^ = i^y^dt). Moreover, 

since p^^ =p :=p(0,0). 



[ \VVe\^^y^^'^-'^\VyV,\^ dydt < j \VVefy^''Uydt 

/■ N-p f p(iV-l) 

< / iVKl^'dydi < C£~ / + + '^(^ dydt 

Jb+\b «_„ Jr^'vs „_„ 



^2s\^ iV-p o/R_|_\S JV-p 

iV-p /" p(^-l) Af-P f+°° -, p(JV-l) 

<C£p-i / p-i dydt<Cep-i / iv-p p f-i dp 
Then, we obtain 

•^^2s\^ N-P 
CsPiN-1) 

Since p < we get that ^ > 2, hence 



'^2s\^ N-p 

CeP(N-l) 



Hence 



a'' [ g{y,t)ri{y,t)\VV,\P^y''^-^d^V,{y,t)d,VS,t)dydt 
Jrn 

= a'^ f g{y,t)\VVefy^'^-^d,Ve{y,t)dMy^t)dydt + 0{e'' 

Jb+ „ „ 



JV-p 
CeP^N-l) 



= a'^ [ g{ey,et)e^^^-'-^'^\VV\P^^y'^'^-^diVdjVdydt + 0{s'^). 

Jb+ 

Letting 



JV(p-i) 

Ce V(N--L) 



\vvr^diVd^v = |vy(y,i)r^, V = (v„5t). 



we obtain 

AT-l 



y^a'^ [ g{y,t)v{y,mV,\P^y''^-^diV,djV,dydt 
i,J=i 

= Bq{£) + Bi{e)e\T\e + B2{e)e + B2,{e){e\nef + Bi{e)£^ Ine + £^R{e) 
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with coefficients Bi{e), i = 0, . . . ,4, defined as 



Af-i „ 
Bo=Va^^5(0)/ (t>.,j{y,t)dydt 



N-l 



Bi = g{0)dtp{0) V a'' / t(l)ij{y, t) dydt 

P i,j=i M 

N-2 

B2=Y^ / 't'ijiy^ (5(0)t9tp(0) In I Vl^l + V5(0)(y, t)) dydt 



N f 

P i,j=i -^K 



+ 5tp(0)25(0)i2ln|VF|)dydt, 



but with integral over B^ instead of and the error term R{e) satisfies 

C£P(Jv-i)-i 



\Rie)\<C j r'^\VV\Phi\VV\{l + rehie)dydt 

Ce P{JV-1) 

< C /" r2|Vy|Pln|Vy|dydt. 



JV(p-i) 

Ce P(^-l) 



Clearly, this last integral is bounded by 

Cy p p-i hip dp 
which is finite since p < ^^y^- Moreover 

\Bo - Bo{e)\ < C / \VV\P dydt < C / jvfa-i) r"^"^ dr < Ce^^^^^ < 

, p(JV-l) 
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since p < 3^35- ^Iso for i = 1,2, 

\Bi-Bi{e)\<C [ \iy,t)\il + ln\VV\)\VV\Pdydt 



+ \ N{p-1 
g p(N-l) 

1 N-v 

< C jv(i-p) r p-i In rdr 

/ePt^v-i) 



/■°° ^ iV-p I ^ 

< C jv(i-p) r p-i dr for any a > 

JeP{JV-i) 

iV(JV-2p+l) g iV^ + TV 

< Ce p(Jv-i) for any /? > and if p < — ^, 
= o{e). 

Eventually, for any z = 3, 4, 

\Bi-Bi{e)\<C [ \{y,t)\\l + ln\VV\)\VV\Pdydt 

5 p(}v-l) 

/•°^ 1 iv-p 

< C iv(p-i) r p-i In rdr 

p(JV-i) 
/•oo l_JV-p 

< C / jv(p-i) r p-i dr for any a > 

Je p(JV-i) 
= o(l), 

since p < ^^3-^- 

Hence if p < N^/{3N - 2), 

iV-l 

= Bo + Bie In £ + + -B3((£ In ef + 54£^ ln£ + 0(£^). 
Finally, using the radial symmetry in the y variable, we can simplify the expressions for the 

For B4, notice that 

N-l 



y^a'^dkipiO) [ \VVfr-\yjy^y' dydt 

V a''dup{Q) [ \VV\Pr-Vi dydt + | V a^'dkkPiO) + 2a^*=9,fep(0) ) / \VV\Pr-Viyl dydt 

N-l 

J2 a'%ip{0) / \VV\Pr-^ {yf - Syjyl) dydt 

N-l 

+ E (a'%kP{0) + 2a"'dikP{0)) l\VV\Pr-Viyldydt 

i,k=i "^'*+ 



N-l 
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The other simphfications follow in the same manner. □ 
Lemma A. 6. Assume p < N'^/{3N - 2). There holds that 

f f{y,tMy,t)\VV,\P(y'^^ dydt = Co + Cie\ne + €28 + Caiehief + Qe^lne + ©(e^) 

with 

C'o=/(0)/ \VV\Pdydt, Ci = --f{Q)dtp{Q) ! t\VVfdydt 

C2= I t\VV\P {f{0)dtpiO) In |VF| + 5^/(0)) dydt 

/V2 r 
C3=^fmdtp{0f t'\VV\Pdydt 

C4 = -- [ t^\VV\P (iP-dttP{Q) + dtp{0)dtf{Q) + dtpiOffiO) In \VV\) dydt 

AT r ""-^ 

~ 2{N - \y\'\VV\P dydt, A, = 

Proof. As before 

f |VK|^'(f'*) dydt < Ce^ = 0{e^). 



N-p 

SO that 



= C'o(£) + C'i(e)£ln£ + C'2(£)£ + C^{e){e\nef + C'4(£)£^ ln£ + 0(£2) 
where the constants Ci{e) are the same as 

C'o = /(0)/ |Vy|Pdydi 

C-i = --/(0)9ij>(0) / t\VV\Pdydt 
P J^l 

C2= f t\yV\P UiO)dtp{0) In |Vy| + dt/m dydt 
Cz = ^f{mP{^f / t^\VVfdydt 

^P JR^ 

(74 = -- / |Vl^rf^(Z?V0)(y,t),(y,t)) + 5tp(0)5t/(0)t2 + 5tp(0)V(0)i'ln|VF|') dydt 

p jr^ V 2 y 

but with integral over n(p-i) instead of M^. We can estimate |C'j(£) — Ci\ as we estimated 
\Bi{e) — Bi\ in the previous lemma. 



20 



J. FERNANDEZ BONDER, N. SAINTIER AND A. SILVA 



Again, using the radial symmetry of V we can simplify the constants Cj as in the previous 
lemma. □ 

With the aid of the previous Lemmas, we can now prove Proposition IA.4I 

Proof of Proposition A. 4 First, by Lemma lA.lt 

/(x)|Vt;,r(-) dx= [ f{y, t)\Vve\P^y''\l - Ht + 0{t' + \y\')) dydt, 



where we denote f{y,t) = f{^{y,t)) and p{y,t) = p(^{y,t)). 



Recall that, by Lemma [A.H 



N-l 



_d_ 

dyi' 



Then 



/ /(y, t)\Vv,fy^'\l -m + 0{t^ + \y\^)) dydt 

f{y, t)|V(r?K)r(^'*)(l -Ht + 0(t^ + \y\^)) dydt 
/(y,t)r?(y,tf (^■*)|VKr(^'*)(l -Ht^ 0(t^ + \y\^)) dydt + R{e) 



where 



\m\ < c 

if p < (n + 2) /3. Hence 

f{x)\Vv,\P^-Ux= I f{y,t)7j{y,tr^y''^ {dtU,'' 



dydt < CeP / r'^^-^^''^ dr = 0{e^), 

5/e 



N-l 



+ i^'' + '^h'H + 0{t^ + \y\^))diVed,Vs 
il-Ht + 0{t^ + |y|2)) dydt + 0{e^) 



2 



with 



N-l 



{dtV.f + J2 i^'' + ^h'H + 0{t^ + |y|2)) diV,d,V, 



i,j=1 



p(y,t) 



|Vi4|p(f'*) 



Af-1 



1 + Y p{y,t)M^\^Ve\-^diVedjVe + ©(t^ + |yp 



|VI4|P(f'*) + p{y,t)th'^VVefy'''^-^diVedjVe + \VVe\P^y '"^ O {t^ + \yf 
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Then 

[ f{x)\Vv,\P^-Ux= [ f{y,t)7j{y,t)P^y''^\VV,\P^y''Uydt 
Jn JR^ 

N-l „ 

+ E / tf{y,t)p{y,t)v{y,ty^y''^\VVe\'^^y''^-^d,VsdjV,dydt 

-H [ tf{y,t)r,{y,tr^y^'^\VV,r^y^'Uydt 
+ 0{e') 

since 

f |VK|P(s^'*)0(t2 + \y\'^)dydt <C [ \{y,t)\'^\VV,\P'-y'^Uydt 
Jm^ Jr^ 

< Ce^ [ \{y,t)f\VV\P+°^'Uydt 

= Ce2 [ \{y,t)\'^\VV\P{l + 0{e)ln\VV\)dydt. 

As before this last integral is finite provided that p < {N + 2)/3. 

The proof now follows applying Lemmas IA.5I and IA.6I □ 
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